DOCOMENT BESOflE 



ED 142 408 



SE 022 659 



ADTHOB 
TITLE 



INSTITUTION 

REPOPT NO 
FOB DATE 
NOTE 



EDRS PRICE 
DESCRIPTORS 



IDENTIFIEES 



Begle, E, G.; And Others 

The Effects of Varying the Number of Practice 
Problems, Number of Examples, and Location of the 
Practice Problems in Elementary School Geometry, 
SMESG Working Paper No, 16, 

Stanford Univ, , Calif, Stanford Mathematics Education 
Study Group. 
SMESG-WP-16 
Apr 76 

37p. ; Not available in hard copy due to marginal 
legibility of original document 



MF-$0,83 Plus Postage, 
♦Educational Research; 



HC Not Available from EDRS. 
Elementary Education; 
♦Elementary School Mathematics; ^Geometric Concepts; 
Geometry; *In struct ion ; Learning; * Mathematical 
Concepts; Mathematicr Education 
Research Reports 



ABSTRACT 

This paper reports two experiments related 
elementary school children's learning of geometric concepts 
geometry experiment investigated the effects of location of 
problems within a programmed text; the polygon experiment i 
two variables, number of illustrative examples presented, a 
of practice problems given. Both experiments involved the s 
fifth-grade students; the experiments were administered con 
in a 5-day period. Students were pretested using arithmetic 
reasoning, geometry, and missing words tests. They were the 
one of two programmed geometry texts depending on the treat 
(all practice immediately after concept vs. practice inters 
The geometry posttest was followed by work with programmed 
polygons and the polygon posttest. Four treatment groups we 
for/ polygons; these were defined by many vs. few examples a 
VS4 few practice problems* Results indicated that overall t 
no difference attributable to massed vs. dispersed practice 
although the effectiveness of distributed problems increase 
mathematics ability. Neither variable in the polygon experi 
found to make a significant difference. (SD) 
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INTRODUCTION 



This study was conducted by the Stanford Mathematics Education Study 
Group in the spring of 1975 with the coor^eration of the Cupertino Union 
School District and four elementary schools in that district.* It was 
designed as a further investigation of results yielded by a seventh grade 
study conducted the previous year in the same district (Pence, 19YU). In 
the earlier experiment, using probability concepts, two variables (number 
of practice problems, and number of examples of concepts) had been mani- 
pulated. The conclusions from that experiment recommended further investi- 
gation of these variables, using other mathematical topics, and at other 
grade levels. 

The study presented here was actually two experiments. The first of 
these, (the geometry experiment) using geometry concepts as the material 
..to be learned, examined the variable cf location of practice problems. 
Two versions of the programmed geometry text were written, each containing 
the same explanation and number of practice problems. The location of 
these problems, however, varied. In cne text, all practice problems came 
imiaediately after the presentation of the concepts (massed practice). In 
the other, the practice problems were distributed throughout the text 
(distributed practice). The experimental question was the examination 
of the relative effectiveness of massel vs. distributed practice. 

The second experiment in this study (the polygon experiment) using 
poli'gons as the topic, manipulated tv;o variables, number of illustrative 
examples presented after each concept, and niimbe'r of practice problems 
associated with each concept. 



*The researcherr acknov/ledge with thanks the Cooperation and assistance 
of the follovring people: Ellie Amundsen, Math Coordinator, and the 
teachers of the participating classes, Ms. Gardner, Ms. Gibbs, Mr. Hargis, 
Mr. McCallam, Mr. Munger, Ms. Pangrac, Ms. Vogel. 



POPULATION 

Seven classes of fifth graders participated in this study. The 
classes were members of five schools, Hansen and Monta Vista (one class 
each), Portal (two classes), and. Stevens Creek (three classes). The 
student body was thought to be of fairly uniform SES ... mainly white 
middle and upper middle class. In actual fact, more variation than had 
been anticipated was observed by the SMESG team. 

As is standard procedure in the Cupertino Union School District, 
the participating classes had been streamed for math by ability groups. 
The classes in this study however included different ability levels. 
This variability should not be relevant to this study since the measured 
variables, pre and posttest scores and differences, are within subject 
dependent measures. 

PROCEDURE 

The procedure required five class periods to complete. 

The first day (May 27) a pretest was administered to all seven 
classes \inder the supervision of the SMESG team. This pretest was a 
three part instrument: 

Part I: Arithmetic Reasoning: 10 item multiple choice 

5 minutes allowed for completion. 

Part II: Geometry: 10 item (part_yes, no; part multiple choice) 

8 minutes allowed for completion. 

Part III: Missing Words: h paragraph abbreviated version of test 

used in previous experiments. 

All tests were adequately timed for most students to complete. 
Following the pretests, all subjects were asked to complete a short 
sample program in order to introduce them to the type of programmed 
materials which were to be used in the experiment. 

The remaining procedures were administered under the supervision 
of the classroom teachers. 
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The secondjaay (May 28 or 29) eacr. student was randomly assigned 
one of two treatments of the programme?, geometry text. 

In Treatment J, all practice problems related to the concept were 
presented immediately after the concept. 

In Treatment one practice problem v;as presented immediate ly after 
the concept. The remaining practice problems were interspersed throughout 
the text. 

The third day , (May 30) students vere administered a tv/enty-- seven item 
ge ometry posttest . 

The fo\'.; -th day , (June 2) each student was randomly assigned one of four 
versions (Q, R, S. T) of the programme! text called Polygons . 

Each version of the polygon's tex^ contained the same total number 
of examples and the same total number cf practice problems. Variations 
between texts occurred by subsets of concepts. In general, there were 
12 polygon concepts. For 6 of the concepts there were 6 illustrative 
examples. For 6 of the concepts there vas only one example. Three of 
the first 6 concepts were followed by - practice problems and three of 
the concepts were followed by one practice problem. The same procedure 
was repeated for the second six concepts. 

To help visualize the text construction, first consider Figure I 
which shows the four combinations (A, z, C, D) generated by 2, two 
valued variables. 
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Figure II shows the distribution of these combinations over the 
12 concepts in each of the four versions of the polygon texts. 



^"-'^^^^^ Concepts 

Combination"""^ 
of Variables 
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10-12 


A 


Q 


R 


S 


T 


B 


R 


Q 


T 


S 


C 


S 


T 


Q 


R 


D 


T 


S 
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Figure II 



Thus, all versions contained all four treatment combinations; they 
differ in that these combinations were applied to different sets of the 
12 concepts in each version. 

The last day (June 3) the polygons posttest was administered to all 
subjects. This was a 12 item test. Each item corresponded to one concept. 

All programs and posttests were written specifically for this experi- 
ment. Concepts were presented in programmed form to control for teacher 
variability. 

SCORING 

A. Geometry 

Scoring of the geometry posttest was conventional. The number of 
correct answers v/as the criterion used to measure the effect of the 
placement of the practice problems on achievement. 

B. Polygons 

Scoring of the polygons posttest concentrated on the niimber of 
errors.*"^ There are, however, two kinds of errors which can occur in 



•^<-*Original scoring instructions are given in Appendix 2. 
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concept formation, overgenez-alizaticr. z.rA undergeneralizat?on. Over- 
generalization is an error v;hich occur: v;hen students have not found 
all of the dimensions. An example of f.- overgeneralization v;ould be, 
when told to mark triangular figures, -r.e student may also mark a square 
demonstrating that the relevant dine-£i:n f the number of sides of a tri- 
angle) was overlooked or overgeneralizr i. Undergeneralization occurs 
when students derive extra dimensions. An example of undergeneralization 
would be failure to identify a triar.gl-^ sho/.T. with the vertex located 
below the base because the student has :oncluded that an irrelevant 
dimension (relative location of the ve;*-ex) is relevant. 

Scoring of the polygons posttest i.icluded measures for both types 
of errors. Overgeneralization scores - scores) were based upon the 
number of nonexamples of a concept vhi:r, 7:ere marked. Undergeneraliza- 
tion scores (U - scores) v/ere a functi::. ox" the number of examples of 
the concept which were not identified. 

ANALYSES AND RESULTS 

A. Item Analyses 

Before the data analysis v;as per: :rned, all cases with missing test 
scores, were omitted. An item analysi- vas performed on the Geometry Pre- 
test, Arithmetic Reasoning Pretest, ar.:. "he Treometry Posttest. Tables 
1-2 of Appendix 1 give the results. 

The reliability of the Arithmetic Reasoning Test was .638 v;hich is 
similar to results obtained from other itudies with Anglo children. 
Both the Geometry Pretest and Posttes: '-.ad satisfactory reliabilities 
(.579 and .813 respectively). 



*^*It is, however, rraite different fr:~ the lovrer reliabilities such as 
.256 which have rer.ulted in studies .^exican-Merican students. This 

difference was the motivation for a si'.Ay of the effects of teaching 
Mexican-American students hov; to us;, -.tit taking strategies. The training 
intervention rained the reliability sirres of the Mexican-American students 
to those expected from Anglo students, bindings are reported in SlffiSG 
Working Paper No. lU. 

o 7 

ERIC 



B. Geometry 

•nie variable of placement of th-^ practice problems was examined 
through the analyses - regression and analysis of covariance. Results 
are sho;m in Tables J>-h of Appendix 1. aNCOVA analyses showed , no signi- 
• ficant treatment differences. T^Jhether the practice was given immediately, 
after the development of the concept or distributed throughout the text 
makes no difference. This lack of any difference is in disagreement with 
t:i- results of, studies by Peterson, Laing, Camp, and Urwiller in which 
the trend, although nob significant, favored the distributed placement 
of practice problems. The math topics for these studies were eighth 
grade arithir,etic or first year high school algebra. 

The i-esults of the ANCOVA must te cautiously examined, however, 
since the homogeneity of Regression assumption was rejected at the .002 
level. Looking at the regression analysis, one predictor, missing words, 
accounts for varying amounts of variance in the posttest achievement. 
A significant amount of variance was predicted in the distributed practice 
treatment (p < .000) while in the massed practice treatment, the missing 
words pretest was net a significant predictor (p < .707). 

The Mirying VJords Test was designed to measar- the ability to read ' 
mathematical prose. An account of the development of this test is found 
in S^^SG Working Paper No. 11, by Roger Jarvis. i-he Missing Words Test 
has been found to be reliable and to correlate significantly with mathe- 
matics achievement. The differential predictive effect of the missing 
words pretest supports the hypothesis that the effect of distributing 
the practice is increased as the student's ability to read mathematics 
increases. 

C. Polygon Posttest 

Means and standard deviations were computed for the pretest data 
for each treatment. (See Table 5 of Appendix l) . Comparisons of pn^- 
test results showed no significant differences between treatment groups. 

In Table 6 of Appendix 1 the results of the simple data description 
are given for the polygon posttest. Both variables included in the 
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polygon text, number of examples and number of practice problems, were 
analyzed independently. Separate analyses were computed for the U-score 
and the 0-score. N^tjier U-score or 0-score comparisons across either 
treatment variable produced any significant difference. 
Examples: In an earlier study with seventh graders and a unit on prob- 
ability, the nvimber of examples provided with each concept v^as not a 
significant variable. Details of the findings are included in SMESG 
Working Paper No. ?• Posttests for both Geometry and Polygons are in- 
cluded in Appendix 5. 
See Table 6. 

The result's of both this present study and the previous study 
support the hypothesis that when an explicit definition is provided, 
the number of illustrative examples variable is swamped. A similar 
conclusion was reached in a recent report by Feldman (197^). 

Practice Problems : Increasing the number of practice exercises did not 
help reduce the number of mistakes made in the learning cf geometry 
concepts caused by either overlooking relevant dimensions or concen- 
trating on irrelevant dimensions. This result contradicts the findings 
of the earlier study which showed interesting results. Increasing the 
niunber of practice exercises helped the less able student deal with 
-relevant dimensions of the concept but v;as not a significant variable 
for the above average students. On the other hand, increasing the 
number of practice exercises did no^* help the less able students deal 
with irrelevant dimensions of concepts although it was helpful for the 
above average students. Increasing the number of practice problems was 
found to be helpful in another pr^evious study (SKiESG Working Paper No. 
15) in which high school students studied a unit on Negative Number 
Bases. The effectiveness across the cognitive levels of Computatiion, 
Comprehension, and Transfer varied according to mathematics sophisti- 
cation. While increased practice helr^ed advanced math students on 
comprehension, the less sophisticed geometry students were helped by 
j.ncreased practice at all three levels of achievement. 



CONCLUSIONS ; 

A. Geometry 

Practice problems can be massied immediately after the concept, 
or distributed throughout tlic t-xt following the concept. The effect 
of the location of the prjcv/ice problems may be a function of the 
student ^s mathematics reading ability. The effect of distributed 
practice problems increaiied as math reading ability increas-d. On 
the average, however, hhere was no difference between massing and 
distributing practice problems in geometry. 

B. Polygons 

Based upon the results of previous SMESG studies, it was antici- 
pated that increasing the n'omber of examples would have no effect on 
achievement. This result was replicated in the Polygons experiment. 

ITie effect of practice problems, however, did not replicate pre- 
vious results. Increasing the numbers of practice problems did not 
increase achievement for the polygon material. One reason for this 
unanticipated result r^ay be the lack of power of the pretests. Learning 
geometric concepts may require specific abilities and thus demand a dif- 
ferent set of pretests. For example, a test of Hidden Figures or test 
on spatial ability may be needed. Another source of variance which was 
not considered in the analyses is school differences. Even though all 
schools were analyzed together, observers related unexpected differences 
between schoolr both in student population and learning atmosphere. 
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APFEriDIX 1 
STATISTICAL TABLES 



TABLE 1 
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TABLE 2 
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TABLE 5 
AWCOVA For GEOMETRY EXPERIMENT 



DEP=>H.)E.JT VARIABLE -- POST GEOMEToy 

GKOUP DEFIfMlTICN —TREATMENT ID - Massed vs Distributed Problems 

ANALYSIS OF C'JVARIANC£ 

SOURCE OF VARIATION ADJ. SS DF AJJ. MS F P 

REC^ESSIUN 2159.189 3. 719.72^ 4L.286 0.000 

TRi^ATMENT MEANS L2.L45 I. Ll.l^b 0.697 O.^Qi> 

HETEROGENEITY 

■jr- REGRESSION 265. L35 3. dJ.iJti 5.070 0.002 

ERROR 3225.09'^ Lap. 17.^33 

TOTAL 5661.562 192. 



ADJUSTED 
MEANS 
VARIABLES HY oRJJPS 

V'UIAbLE .NAVE NO. GROUP L GRJJ^ 2 TOTAL 

PC;ST GEOMETRY 5 25.52 23.01 25.26 



TABLE k 

GEOMETRY EXPERIMENT ■ REGRESSION RESULTS 



Treatment J -- Massed Practice Problems 
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Treatment X - Distributed Practice Problems 
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TABLE 6 ■ ■ 
POLYGON EXPERIMENT - POSTTHST RESULTS 
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Practice 




U-score 1 


0-5core 


' Many- 


6.715 
s.d.3.758 


6.321 
s.d,3.5^0 


Few 


7.135 
s.d.3.896 


6.353 
s.d.3.320 
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APPENDIX 2 
SCORINa INSTRUCTIONS 
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Directions for Analysis* of the Polygons Test 

On the Mster scoring sheet for this test some of the figures 
in each item were outlined in color (these were always the figures 
which were exanples of the polygon stated in the stem of the item 
both for the IS form of the stem and for the IS NOT form). 

For each student and for each item two numbers were to be 
recorded. The first was the number of colored figures which 
were not marked by the students. Call this the student's A-score 
on this item. The second number was to be the number of uncolored 
fig^^res which were marked by the students. Call this the student's 
B-sccre, 

We will now create, for each student and for each item a U-scor( 
and an 0-score. This is done by flipping the A and B scores for half 
the items as sho^^ in Table 1. 

For each student ve now construct 8 composite scores. The rules 
for constructing these scores depend on the particular form (Q, R, S, 
or T) of the Polygons program which the student used. The rules for 
forming scores S-I, E-II, P-I,. P-n are shown in Table 2. 

We construct score E-III using exactly the same rule as E-I, 
except that the U-scores are replaced by the 0-scores. Similarily 

follows the same rule as E-II but replaces t^e U-scores by the 
O-scores. 

P-III uses the same rule as P-I and P-IV uses the same rule as 
P-II, In each case replacing the U-scores by the O-scores. 

We now use t-tests to determine whether the distribution of E-I 
and E-II are different and similarily for the pairs E-III and E-IV, 
P-I and P-II, and P-III and P-IV. 



Itea Iramber 
1 

2 

I. 
c 

5 
6 
7 
3 
9 

10 
n 



Table 1 

0- Score 
B 
A 
B 
B 
A 
A 
B 
B 
A 
A 
B 



U- Score 
A 
3 
A. 
A 
B 
B 
A 
A 
B 
B 
A 



Table 2 



Score Form 

E-I Q Sum of U-scores on items 1-6 

R " " 1-6 

S " " 7 _ 12 

T . " " 7-12 

E-II Q Sam of U-scores on items 7 - 12 

R " " 7-12 

S " " 1-6 

T " 1-6 

P-I Q Sun of U-scores on items 1-5 and 7-9 

R " ■' h - 6 and 10 - 12 

S " " 1 - 5 and 7 - 9 

T " k ~ 6 and 10 -12 

P-II Q Sua of U-scores on items h - 6 and 10 - 12 

R " " 1 - 5 and 7 - 9 

S " " k - 6 and 10 - 12 

T " " 1 - 5 and 7 - 9 
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APPENDIX 5 
POSTTESTS 
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GEOMETRY 



Name: 
Sex: 
Date: 
Time: 



Begin 
End 



Stanford Mathematics 
Education Study Group 



EKLC 
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In the box bslow, how niany points are repreBented by dotfi? 




Mark ^o\xt points in the space below. 

Name them with the first four letters of the alphabets 



The cmrve below connects points _SLnd 




Is IIP a correct name for the curve above? 

Is there a curve shown f^oin^^ from A to M? 
Is there a curve shown golnjj from M to E? 




N L V T H 

How many points are marked on line segment KR? 



aS is a line segment • 

Does a line segment have endpoints 



In the figure below, is M an endpoint of line segment MC? 

Is R an endpoint of line segment MC? 

Is C an endpoint of line segment MC? 
M B C 



Mark an X on each line segment "belowp 



Line segment 1?? is shown below* 



S 




Write names for two other line segments • 

Is ioT part of KS? ' 

Is loT part of NS? 

^ R D ^ SlT is a lin#. 

Does a line have endpoints? 



• \ 
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Write two more names for this line* 
Is line segment 51Ii j^rt of line 
Is PC part of ^? 



13. Mark an X on each line "below^ 



111, 




Name the points marked on the line above 



is a correct name for the line aboveo 
Another correct name for IT? is 



15. Here is a picture of ray YZ, 



Name the endpoint of ray 




16. Mark an X on each ray in the figure below. 



17. Here is a picture of a line* 




Name thre3 rays on this line. 



18. Name the rays that form this ang-leo 



Name the point at which the xays meet. 




19. 




Mark all the angles in this figure* 



20. Mark the angles in the figures below, A for aeute angle, 

0 for obtuse angle, 
H for right axigle* 





21. Mark all the right angles with an R* 



ERLC 




22. Mark an X on the figures below which are closed curves o 





O 



25. Mark an X on the figures below which are sinple closed curveso 



gl^^ * vMcih Of these are pictures of polygons? 
Mark each nolygon.with a P. 



25. 



Name the intersection points on each figure below. 





POLYGONS 
Form A 



There are twelve questions in this booklet. Each one shows some 
geometric shapes. You are told to mark some of them. Here is an 
example : 

0. Mark an x on each CIRCLE. 




Here is another example: 

Mark an X on each figure that is NOT a CIRCLE. 




Name : 

Sex: 

Date: 

Time : Begin 
End 



Stanford Mathematics 
Education Study Group 



ERLC 
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Mark an X on each ACUTE ANGLE TI^ANGLE. 

A O V L 




Mark an x on each figure that is NOT a RIGHT ANGLE TRIANGLE. 

^ Q 



Mark an X on each figure that is NOT a OBTUSE ANGLE TRIANGLE. 
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Mark an x on each WADRILATERAL. 

^ A M 




n 





Mark an x on each TRAPEZOID. 




] 




Z3 n 




MaViC an X on each figure that is 1K)T a PARALLELOGRAM. 






ZZ7 
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Mark an x on or^ch fi^^uro !.hot ir: NOV a KJIOMHUo 

0 V < ^ 




Mark an x on each RECTANGLE. 




Mark an x on figure that is NOT a KITE^ 



